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What is claimed is: 



Iv A method for performing motion analysis on a sequence of images, 
where said sequence of images captures a plurality of objects each moving 
alongXtrajectory in an imaged area, said method comprising: 

extaracting motion information for each of said plurality of objects 
contained inWid sequence of images; and 

determiriijng spatial patterns from said extracted motion 
information. 

2. y The method of claim 1 wherein said determining of spatial patterns 
comprises^ . 

detehafning a route comprising a trajectory of a first object having 
the same tr^ectory of at least one other object. 

8. The method of claim 2 wherein said determining of said route 
\ 

comprises: 

\determining whether said trajectory of a second object is within a 
threshold distance said trajectory of said first object; and 

including, if said trajectory of said second object is within the 
threshold distance, said trajectory of said second object in said route. 

4. The metlibd of claim 1 wherein said determining of spatial patterns 

comprises: \ 

determining a^source point and a destination point from said 

trajectory of said plurality of objects. 

5 The method of claim^i wherein said determining said source point 

\ 

comprises: \ 

determining whether a number of trajectories originating from a 

location is greater than a thresholdsnumber; and 

identifying, if the number of trajectories originating from the 
location is greater than the threshold number, the location as said source 
point. 
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v6 The method of claim 4 wherein said determining said destination 
\ 

point comprises: 

determining whether a number of trajectories ending at a location 

5 is greater than a threshold number; and 

\ identifying, if the number of trajectories ending at the location is 
greater than the threshold number, the location as said destination point. 



25 



7 The method of claim 4 wherein said source point and said 
\ • . 

10 destination point are determined using a clustering process. 

\ 

8. The method of claim 1 further comprising: 

determining spatio-temporal patterns from said determined spatial 
patterns along a^ime dimension. 

15 

9. The method of>^laim 8 wherein said determining of spatio-temporal 
patterns comprises: \ 

determining a bugy time for said route, where the busy time 
represents a time when a^numbe^ of trajectories for said plurality of 
20 objects along said route is greater than a threshold number. 

10. The method of claim 8 wherein said determining of spatio-temporal 
patterns comprises: \ 

determining a periodicity oPat least one trajectory in said route. 



11. The method of claim 10 whereirixsaid determining the periodicity 



comprises: 

selecting a time scale; and 
determining whether a first occurrei^ce of an event along said route 
30 and time scale is periodic with subsequent occurrences of said event along 
the same route and time scale. 

12. The method of claim 11 wherein said even\comprises said 
trajectory of said first object. 
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la. The method of claim 11 wherein said event comprises a number of 



s^d trajectories greater than a threshold value. 




The method of claim 1 further comprising: 

determining a first route comprising a trajectory conamon to a first 
set of at least two objects; 

determining a second route comprising a trajectory common to a 
second set of at least two objects; and 

determining whether said trajectory in said first route is time 
correlated wi£h said trajectory in said second route. 



15. A method for displaying motion information of objects contained in 
a sequence of images, the method comprising: 

performing a c^ery on a plurality of spatial patterns stored in a 
database, where each d£ said plurality of spatial patterns comprises a 
route determined from aVajectory common to at least two objects moving 
in an imaged area captured in said sequence of images; 

determining a trajectory satisfying at least one constraint specified 
in said query; and \ 

displaying said determined trajectory on a user interface. 

■\ 

16. A system for performing motion analysis on a sequence of images, 

\_ 

the apparatus comprising: 

a motion extraction system for receiving said sequence of images 
capturing a plurality of objects each moying along a trajectory, and 
extracting motion information for each of^said plurality of objects over said 
sequence of images; and ^ 

a motion mining system for determining spatial patterns from said 
extracted motion information, where said spatial patterns comprise a 
route determined from said trajectory commonUo at least two objects. 

17. The system of claim 16 further comprising \ video source for 
capturing said plurality of objects in an imaged area and transmitting 

\ 
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vid& containing said captured plurality of objects to said motion 
extraction system. 

\ 

18. The system of claim 16 further comprismg: 

a cLatabase for storing said spatial patterns determined from said 
motion nntiing system; and 

a seAer computer for retrieving said trajectory satisfying at least 
one constrain^; specified in a query. 

19. The system of claim 16 wherein said spatial patterns comprise a 
route having a trajectory of a first object that is the same as the trajectory 
of at least one other object. 



20. The system of claim 16 wherein said spatial patterns comprise a 
source ] 
objects. 



source point and a de^ination point for said trajectories of said plurality of 




21. The system of claim 16 wherein said motion mining system 
determines spatio-temporal patterns from said spatial patterns along a 
time dimension. 




22. An apparatus for performiAg picture analysis, the apparatus 
comprising: \^ 

a memory for storing a motion mining program; 

an interface for receiving motimi information containing trajectory 
information for a plurality of objects enured in an image sequence; 

a processor, upon executing said nK)tion mining program retrieved 
from said memory, determines spatial patterns from the received motion 
information. 

23. The apparatus of claim 22 wherein said^patial patterns comprise a 
route having a trajectory of a first object that is the same as the trajectory 
of at least one other object. 
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24. rme apparatus of claim 22 wherein said spatial patterns comprise a 
source pckint and a destination point for said trajectories of said plurality of 
objects. 

25. The apparatus of claim 22 wherein said processor determines 
spatio-tempc^ral patterns from said spatial patterns along a time 
dimension. 



